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ERROR  STATISTICS  FOR  NORMAL  RANDOM  VARIABLES 

’NTRODUCTION 


The  performance  of  systems  involving  target  positioning,  weapon  delivery, 
scoring,  etc. , is  influenced  by  a variety  of  random  disturbances  or  errors. 
Hence,  u complete  description  of  system  performance  requires  knowledge  of  the 
probability  distribution  of  system  errors.  Often,  a single  statistic,  derived 
from  these  distributions,  is  used  to  quantify  V results  of  the  tested  systems. 
And,  because  different  statistics  are  used  for  .'efferent  applications,  it  is  diffi- 
cult (sometimes  impossible)  to  meaningfully  assess  the  relative  performance  of 
individual  systems.  Similarly,  it  is  not  always  simple  to  convert  from  one 
statistic  to  another  unless  the  data  are  available  or  assumptions  are  made  about 
the  underlying  distributions. 

The  use  of  the  normal  probability  distribution  for  describing  errors  and 
related  phenomena  is  almost  universal.  Its  applicability  in  describing  errors 
can  be  deduced  from  basic  assumptions,  * or  its  use  can  be  justified  by  the 
central  limit  theorem. 

An  n-dimensional  normal  random  vector,  whose  components  represent 
errors  or  otherwise,  can  be  completely  described  statistically  by  specifying 
its  mean  vector  and  covariance  matrix.  However,  there  are  many  instances 
where  it  is  necessary  to  represent  the  distribution  or  to  describe  system  per- 
formance with  a single  statistic  or  number.  Four  statistics  commonly  used 
for  this  purpose  are  the  root  mean  square  error  (RMSE),  the  mean  radial 
error  (MRE),  the  geometric  mean  error  (GME),  and  the  spherical  or  circular 
error  probable  (SEP  or  CFT).  Each  of  the  above  statistics  has  been  indivi- 
dually treated  in  the  literature,  but  often  only  for  special  cases,  such  as  equal 
variances  along  the  component  axes. 

This  report  examines  the  relationship  between  these  four  error  statistics 
for  the  case  where  the  errors  obey  a normal  or  Gaussian  probability  law.  The 
four  statistics  are  surveyed  and  compared  for  zero-mean,  normal  random  var- 
iables in  two  and  tnree  dimensions.  Exact  expressions  are  given  for  RMSE, 
MRE,  and  GME.  Approxin  ?te  expressions  are  presented  for  SEP  and  CEP. 

The  formulas  apply  for  independent  random  variables.  However,  it  is  shown 
how  these  equations  can  also  be  used  to  calculate  the  statistics  for  variables 
having  an  arbitrarj  covariance  matrix.  The  results  are  presented  in  a form 
that  facilitates  the  evaluation  of  the  statistics. 
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STATISTICS  FOR  INDEPENDENT  RANDOM  VARIABLES 


The  joint  probability  density  function  for  n real,  zero- mean,  normal 
random  variables  xj,  x2,  . ..,  xn  has  the  form 


fx(xl’  x2’  •*”  xn)T  (2^)"I1//2  K exP  (-1/2  xT  K-1x)  , 


-1/2 


(1) 


where  x is  a column  vector,  and  | K | is  the  determinant  of  the  n x n covar- 
iance matrix  K = (kjj>,  with  kjj  - E (xp<j',  the  expected  value  of  the  product 
xixj.  For  independent  random  variables,  kjj  - 0 unless  i = j.  In  any  case, 
leu  = cr?  , the  variance  of  The  surfaces  of  constant  probability  are  found 
by  setting  the  quadratic  form  -1/2  xTK~lx  equal  to  a constant.  Those  surfaces 
are  ellipses  in  two  dimensions  and  ellipsoids  in  three  dimensions.  Since  the 
variables  are  uncorrelated  with  zero  means,  the  density  function  for  the  n 
variables  is  completely  determined  by  the  standard  deviations  (sigmas) 
orj.  Cf2*  • • • * CTn’  **  will  be  assumed,  without  loss  of  generality,  that 

°T  ^ ^2  s ■ °n* 

ROOT  MEAN  SQUARE  ERROR  (RMSE) 

The  RMSE  for  n dimensions  is  defined  as 


RMSE  = 


/n  \ 1/2  /n  „\l/2 

(£>)  yJ)  • 


(2) 


This  statistic  is  trivial  to  compute  and  is  widely  used  because  of  its  simplicity. 
It  differs  from  the  other  three  in  that  the  definition  itself  provides  the  desired 
closed-form  expression  in  terms  of  the  variances  of  the  x.. 

MEAN  RADIAL  ERROR  (MRE) 

For  n variables,  the  MRE  is  defined  as  the  expected  value  of  the  radial 


error 


That  is. 


(X? 


^ 2 A 2 \ 1/2 
+ x2  + ...xn)  . 


+ x2  + * * * Xn)1/2 


nOD  /*T0 

...  I ( x^ 

— uw  -**>  -00 

(^1 f x2  * • • • t ^x2  • • » • (3) 


A 


TR  4724 


Or,  in  shorter  notation, 


MRK 


nCO  p CO 

...  j |C|  ‘x(C)dC. 

- - VO  - «*» 


(4) 


o 

For  n - 2,  the  moments  of  the  radial  error  are  known,  with  the  first  moment 
being 

MRE  (2/ff)l/2  CTt  E (l  -o\/o\)>  (5) 

3 

where  E(m)  is  the  complete  elliptic  integral  of  the  second  kind 

E(m)  - f ^1  - m sin2  B^j1''2  d0.  (6) 

“'O 


Tables  for  E(m)  can  be  used  to  evaluate  equation  (5),  and  approxima- 
tions are  also  available^  if  computer  programming  is  desired. 


Expressions  for  the  MRE  are  not  available  for  ni  3,  except  for  the 
special  case  where  oq  0-3  . . . crn.  In  this  ease,  both  the  mean  and  variance 

of  the  radial  error  can  be  found,4  together  with  the  distribution  function.  The 
distribution  function  of  the  radial  error  is  available  and  will  be  discussed 
later  for  the  case  of  unequal  variances. 

A formula  for  the  qth  moment  of  the  radial  error  in  n dimensions  has 
recently  been  developed  by  D.  Childs,  where  q is  any  non-negative  number, 
not  necessarily  an  integer.  The  case  q = 1 and  n = 3 gives  the  radial  error 
in  three  dimensions.  Since  that  work  is  not  yet  published,  the  proof  for  the 
special  case  is  included  here.  By  definition 


. ,1/2  . ,-3/2  f"  f*  2x  2,  2 \ 1/2 

MRE  = (abc)  1 7T)  I I I ( Xj  + x2  ' x3  ) 

— CO  — 00  — 00 

x exp  ^-ax2  - bx2  - cx2  ^ dx^  dXg  dx^  , 
where  a = l/^2cr2),  b = l/^2iy2^,  and  c = 1/^2ct2  ^ . Hence,  a £ b 2:  c. 


(7) 


3 
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Let 

x - r sin  0 cos<p 
y = r sin  0 sino 
z - r cos  0. 

2 

The  Jaeobian  for  the  transformation  is  r sin  0,  and 


MRE  = (abc)1'/2(ff)"3'/2  f f f r3  expi-r*  0)  sin  0 dr  d<pd0,  (8) 

•'O  ^0  *^0 


2 2 2 2 2 
where  0 = a cos  <p  sin  0 + b sin  <p  sin  0 + c cos  0 , 


Integration  over  r gives; 

>1/2  v .-3/2  fn  f2n 


MRE  * (abc)"'41  (n) 


Jf 

Jo  Jo 


sin  0/(2  0 ) d<p  d0  . 


(9) 


2 2 2 2 

Since  0 = b sin  0 + c cos  0 + (a  - b)  sin  0 cos  <p , the  integral  over  <p  becomes 


I = 


2 IT 


•It/ 2 


1/(2  82)  d<p  = 4 1/2  ( X + (X  cos2  <pf 2 d<p  , 

0 ■'O 


2 2 2 

where  X = b sin  8 +c  cos  0,  and  4 = (a  - b)  sin  0.  In  deriving  expressions 
for  the  MRE  in  three  dimensions,  four  separate  cases  are  treated.  If  a = b = c, 
then  I = 17/c  , and  it  follows  from  equation  (9)  that 


1 /2 

MRE  = 2 ( 2/tr)  ' 0^  for  = cr2  = cg  ; 


(10) 


otherwise , 


*ff/2 


I * 2 


n/2  -2  rn  -2 

I (X  +(i/2  +fi/2  cos  2<p)  d<p  = I (X  +/i/2  +n/2  cos0)  djjii , 
•'O  ■'O 


and 


I = n (X  +m/2)  [(X  +m/2)2  - (m/2)2]  '3/2 


4 


(11) 
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Replacing  (11)  back  in  equation  (9),  expanding  ^ and  X , and  letting  x - cos  0, 
gives 

MRE  = (abc)1/2  (it)  1/2  f [l/2(a  + b)  -(l/2(a  + b)  - c)x2j 


x (a  - (a  - c)x2)-3/2  (b  - (b  - c)x2)"3,/2  dx  . (12) 


When  a>b  = c,  it  follows  that 

MRE  = (2 / tt)  1 /2  [c3  + <TX  (l  - a2 /a2  )'1/2  sin"1  (l  - a\/ a\  )1/2J  (13) 

for  <t1=(T2>C3  • 

Equation  (13)  was  written  in  the  above  form  to  illustrate  that  the  ratio 
of  the  MRE  to  crp  the  largest  sigma,  depends  only  on  the  ratios  o^0!  and 
o3/ cti  . This  property  is  enjoyed  by  all  the  other  statistics  discussed  here, 
and  the  eq  \ations  will  be  written  in  a form  that  displays  this  fact.  For  ine 
case  a = b>c,  the  result  is 

MRE  = (2/tt)V2((T1  +03/(26^)  In  [(1  + 6)/(l  - 6)])  (14) 

for  Oj  >cr2  = O3, 


where  6 = (l  - a\/ o\  )1/2  . 


For  the  case  a > b > c,  equation  (:  2)  can  be  written  in  the  form 
MRE  * 2(abc/*)1/2  [(a  - c)(b  - oS]  *3/2  [-*  ['(a2  - x2)'1^*2  - x2)-3/2  dx 

L ■'o 


where  a2  = b/(b  - c),  h2  - a/(a  - c),  ct2  = (a  + b)/2,  and  t2  = (a  + b)/2  - c. 


(a2-rV)  J"1  (a2  - x2)"3//2(s2  - x2)' 


■3/2 


dx 


5 


hphi*uiwp|u  4i*,i  i ii  1 1 1*«,«  H f*p)pppp|f m q v 


5*?T*i » *EW WV*'.  H M *“  V \T*V*.  V % '■‘f’Y’.' 
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Evaluating  the  integrals6  gives 

MBE  = (2/ff)1/2  j^CT2ff3)/CT1  + (CTg /&!>  (1  - <j\/a\)~l/2  F (77,  t) 

+ 0*1  <1  - a2/o2) 1//2  E (77,  t)j  for  a,  > ct2  > cr3  , 

. . -1/,  2,  2\'/2 
where  r\  = sin  ^1  - CTg/aj  ! , 

4 ” [(l _ct2/cti)/(1  - CT3/CTl)] 1/2  * 


(16) 


and  where  F(r/ , t)  and  E(r),  t)  are  elliptic  integrals  of  the  first  and  second 
kind,  respectively: 


r 

P'  ‘ 


F(r?,t)  = f ^1  - t2  sin2<o^-1^2  dcp 
•'O 

E ( rj,  t)  = r(l-t2sin2^)1/2dcp. 

Equation  (15)  must  be  evaluated  with  the  aid  of  tables  since  no  approximations 
are  available  for  E and  F.  All  of  the  other  expressions  given  can  easily  be 
put  in  algorithmic  form. 


GEOMETRIC  MEAN  ERROR  (GME) 

For  n = 2,  the  GME  is  defined  as  the  radius  of  a circle  having  the  same 
area  as  the  50-percent  ellipse,  where  the  50-percent  ellipse  is  defined  by  the 
equation 

fX(Xl’ V ^1  clx2  = °*5  ■ (16) 

2,2  2,  2 „ 2 

xl/crl  + x2/ct2  S C 

The  substitution  Xj  = o^  r cos  o,  x2  ~ a2  r s*n<5  ^eacls  to  the  well  known  re- 
sult 

1 _ e“c2/2  = 0.5  . (17) 


8 


MaMiMilfeMi 
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2 2 2 9 2 

Hence,  o 1.177;  and,  since  the  50-percent  ellipse  x^/cr^  + Xg/o/J  ~ c *ias 
an  area  of  ir  c-  ct.>  , one  gets 


G ME 


i.  177  (OjCTg) 


1/2 


(18) 


For  n - 3,  the  GME  is  the  radius  of  a sphere  having  the  same  volume  as  the 
50-percent  ellipsoid.  The  analog  of  equation  (17)  is 

(2/ir)1/2  f r2  exp  (-r2/2)  dr  0.5. 

*'0 

Integration  by  parts  gives  the  transcendental  equation 

H (cA/2)-  c/JZ  H (c//1T)=  0.5  , (19) 

| *7 

where  Hand  H are  the  error  function  and  its  derivative: 

H(x)  = 2/rr  f exp  (-a2) da  , 

■^0 

H*(x)  =2/*frr  exp(-x2)  . 

Using  the  tables  gives  c = 1.54,  and 

GME  = cicTjCTgCTg)1773  - 1.54  (^a^Xg)1^3  . 

CIRCULAR  AND  SPHERICAL  ERROR  PROBABLE  (CEP,  SEP) 

For  n = 2,  the  CEP  is  defined  as  the  radius  of  a circle,  centered  at  the 
origin,  within  which  the  random  vector  (xj,  Xg)  lies  with  probability  0.5. 

The  SEP  is  similarly  defined  for  a sphere  when  n = 3. 

Exact  expressions  are  readily  available  for  CEP  and  SEP,  but  they  are 
not  in  closed  form;  that  is,  they  are  usually  integral  expressions  requiring 
numerical  techniques  in  their  evaluation.  8*9  Some  analytical  approximations 
are  available  for  these  quantities;  but  they  are  generally  not  accurate  for  all 
values  of  the  rri  . These  results  often  appear  as  special  cases  of  more  gen- 
eral problems  regarding  the  radii  of  circles  or  spheres  including  a certain 
percent  of  the  normal  probability  distribution,  ^ or,  equivalently,  the 


7 


m 


'•  v v w ; w ,Tf?eTrrr'^  ■^fs 
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distribution  of  the  radial  error.  These  in  turn  are  included  in  the  pr  Mem  of 
calculating  the  distribution  of  quadratic  forms, 


where  the  Xj  are  normal  and  independent  with  mean  zero  and  variance  one. 
Many  of  these  problems  can  also  be  equated  to  that  of  integrating  a circular 
normal  distribution  over  certain  regions  in  space.  *3  (The  cited  references 
represent  only  a sampling  of  the  extensive  literature  available  on  these  topics.) 

Values  for  CEP  and  SEP  have  also  been  tabulated  as  special  cases  of  the 
distribution  of  quadratic  forms.  14,15  Here,  simple  rational  expressions  are 
presented  that  approximate  CEP  and  SEP  with  accuracies  within  a few  percent 
for  all  values  of  04,  i ' 1,  2 or  i - 1,  2,  3.  The  approximations  are  not 
obtained  analytically,  but  by  fitting  equations  to  existing  curves.  They  are 
more  uniformly  accurate  than  existing  approximations  and  more  convenient 
than  tables. 

For  n - 2,  and  it  is  known*  that  CEP/cri  is  approximately 

linear  in  02/01,  *or  0-3  ^ 02/01  ^ 1.  Also,  a quadratic  fits  the  curve  well 
on  [0,  0.  3],  Since  SEP  = CEP  when  03  ~ 0,  it  was  conjectured  that  such  an 
approximation  would  be  suitable  for  all  values  of  03/01*  That  is,  it  was 
assumed  that 


!C1  + c2  (cr2/fTl)  for  °-3s:  (r2//<yl  * 1 * 

2 

°3  + C4  (CT 2^ CTl)  + c5  ((T2y/(Tl)  for  0 S CT1  5 °-  3 » 

where  the  coefficients  cj  depend  on  03/01.  Using  existing  curves^  for 
SEP/01  versus  cg/tfl*  with  03/01  being  a parameter,  approximate  values 
for  the  cj  were  found  for  03/01  = 0,  0.1,  0.2,  ...,  1,0,  and  the  cj  were 
plotted  versus  03/01  • A linear  function  in  03/ Oi  was  fit  through  the  values 
of  C2  on  [0,1],  ana  a piecewise  linear  function  was  fit  to  cj  on  [0,0.3]  and 
[0.3,1].  The  C4  and  Cg  were  nearly  constant  on  [0,  0.3],  and  Cg  was  fit 
with  a quadratic.  The  resulting  approximations  are 


SEP**  0. 670  0^  - 0.015o2  “ 0.066o3  + 0.888o^/o1  + l.HOg/o1  (20) 


3 U1 


for  o2/ Oj  5 0. 3,  Og/Oj^  ^ 0.  3; 


SEP  <=»  0.  558o^  + 0.622o2  + 0. 2830g  - 0.  lOSOgCg/ O^ 


for  a2/o1  a 0. 3,  Og/Oj^  ^ 0. 3; 


' ^r^>.^guw»  -~r - “■p/sMwp'W.  ^gf^gBPiggjijlssP u r ’^TnSr*V?V7S^W,W^ 
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SEP  <=»  0. 462  0^  + 0. 622 (j^  + 0. 62l0g  - 0. 16502  0^/0^  (22) 

for  02/ 0j  2 0.  3,  ct3/01  > 0.3  . 


Wlien  03  - 0,  equations  (20)  and  (21)  give 

CEP « O.67O0J  - 0.  O1502  + 0.88802/0^  for  03/01^  0.3  ; (23) 

CEP«=  O.5580J  + 0. 622  02  for  0.3  . (24) 

These  approximations  were  evaluated  and  compared  to  the  curves  for 
values  of  02/01  and  03/01  between  0 and  1 in  0. 1 increments.  The 
agreement  was  within  2 percent  for  all  points  tested,  and  the  accuracy  to  which 
the  curves®  could  be  read  was  about  1 percent. 

The  best  of  the  analytically  derived  approximations  to  SEP  is  probably 
that  of  Grubbs,  17  namely 

SEP~  (CT2  (i-v/9)3)1/2  , 
where  02  - o\  + a\  •*  03 

v = 2(rl  +at+4)/(j4- 

This  is  somewhat  simpler  than  the  expressions  in  equations  (20),  (21),  and 
(22),  and  there  is  agreement  within  a few  percent.  The  advantage  of  the  form 
discussed  here  is  that  improvements  could  be  made  by  reducing  the  error  in 
reading  the  curves  and  by  using  more  refined  curve  fitting  techniques.  Signi- 
ficantly higher  accuracy  should  be  attainable  without  changing  the  form  of  the 
equations. 


9 


TR  4724 


STATISTICS  FOR  CORRELATED  VARIABLES 


The  formulas  in  the  preceding  section  apply  to  independent  random  vari- 
ables, but  a change  of  variables  allows  one  to  use  those  results  for  the  general 
case  where  K is  not  diagonal. 

Since  any  covariance  matrix  K is  real  and  symmetric,  there  exists  a 
real  orthogonal  matrix  P such  that 

PKPT  = PKP-1  = D , (25) 


where  D is  a diagonal  matrix.  The  entries  in  D are  its  characteristic 
values,  which  are  just  the  characteristic  values  of  K since  equation  (25) 
defines  a similarity  transformation.  Making  the  transformation 


y - Px, 

the  joint  density  for  the  ylt  y2,  . . . , yn  is  given  by 

£y(5,1-5'2 yn) “ fX  (P'ly)  I J I • 

where  J is  the  Jacobian  of  the  transformation  P.  Since  P 
| j|  = 1,  and  the  joint  density  for  the  y^  becomes 

fY(yr  y2*  '•*’  yn)~  (2 ff)-n/2  J D j — 1 exp  (-1/2  yT  D 


(26) 

(27) 

is  orthogonal, 

-1y)  • (28) 


Hence,  the  yj  are  jointly  normal  with  the  diagonal  covariance  matrix 
PKP”!  = D;  that  is,  they  are  independent  with  variances  equal  to  the  charac- 
teristic values  of  K. 


For  the  two-dimensional  case,  the  variances  d^i  and  d22  of  y^  and 
y2  are  the  solutions  to  the  quadratic  characteristic  equation  for  K;  namely 


2k  k + 4k^  ^ l/2”l 

11  K22  12/  J ’ 

n = 1,  2 . 


(29) 


For  the  three-dimensional  case,  the  characteristic  equation  is  a cubic 


a^d 


a2d  + 


ar 


(30) 
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where 


let 


and 


al  = _(kll  + k22  + k33y  ’ 

a2  ' kU  k22  + kll  k33  + k22  k33  " k12  ~ k13  ~ k23  ’ 

a3  = "kll  k22  k33  + kll  k23  + k22  k13  + k33  k12  “ 2k12  k13  k23  5 


H = (a2)/3  - (a1)/9  , 


G - a3  - (ax  ag)/3  + (2aJ)/27  , 


E - G2  + 4H3 


The  roots  to  equation  (29)  must  be  real  and  positive.  It  follows  that  either 
E = 0 and 


dll  d22 


d33  “2 


G/2 
G/2 


1/3 


sgn(G)  - (0^/3, 


1/3  sgn(G)  - (a1)/3; 


(31) 


or  E < 0 and 


d = 2 (-H)1/2  cos 
nn 


— -^3  + 9 -{a^/3,  n = 1,  2,  3 , 

— _ 


where 


0 = cos 


f 2(-H3)1^2j 


N, 

(32)  x. 


(33) 


This  is  not  the  most  computationally  efficient  method  of  solving  the  cubic;  but 
it  is  easily  programmable  and  it  is  exact. 

Hence,  given  an  arbitrary  covariance  matrix  K,  either  2x2  or  3x3, 
its  characteristic  values  can  be  obtained  using  equation  (29)  or  equations  (31), 
(32),  and  (33).  Denoting  these  values  by  erf  , er|  (or  exf,  i = 1,  2,  3),  with 
cr j s a2  (or  ctj  s or?  & 03),  the  four  statistics  can  be  calculated  with  the 
equations  given  in  the  preceding  section.  To  justify  this  procedure,  it  must 
be  shown  that  each  of  the  four  statistics  is  invariant  under  the  orthogonal 
transformation  of  axes  defined  by  the  matrix  P. 
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The  square  of  the  HMSE  is  the  trace  of  the  matrix  K and,  hence,  the 
sum  of  the  characteristic  values,  which  is  invariant  because  K and  D are 
similar  matrices  by  equation  (25). 

For  the  other  three  statistics,  only  the  case  n = 2 will  be  discussed, 
since  the  arguments  are  essentially  the  same  for  n = 3. 

The  50-percent  probability  ellipse  has  the  equation 


T -1 

x K x = c 


where  c > 0 is  that  unique  number  that  satisfies  the  equation 


// 


T -1 
x K x^c 


‘x  (x)  dx  = 0. 5 


Making  the  formal  change  of  variables  y = Px,  and  recalling  that  [ Jj 
since  P is  orthogonal,  gives 


//  fv  (p-1 


T - 1 

y D y^c 


x (P  y)  dy  = 0.5  ; 


and  it  follows  from  (27)  that 


// 


T ~-l  . 

y D y£c 


fy  (y)  dy  = 0-  5 . 


Hence,  the  same  value  of  c defines  the  50-percent  ellipse  for  the  yj , given 

by 

yT  D- 1 y = e . (38 

Let  A(x)  and  A(y)  denote  the  areas  of  the  two  50-percent  ellipses, 
with  GME(x)  and  GME(y)  being  the  geometric  mean  errors  for  the  x and  y 
vectors.  Then,  the  transformation  y = Px  gives 


A(x)  = J J dx  = J J dy  = A(y)  . 

T -1  T -1 

x K xsc  y D y^c 
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It  follows  that 


GME(x)  =(A(x)/tt)1/2  = (A(v  )/ff)1/2  = GME(y) 

Similarly,  for  the  MRE,  let  || xjj  = (Xj  + x2)1//2  and  ||yj)  - (y2  + y2)1//2  • 
Since  orthogonal  transformations  preserve  length,  the  transformation  y = Px 
yields 


1/2 


MRE  = 


noo  /*CO  y*oo 

lx|fx(x)dx  = J j p-iy  fx(P~1y)dy 

. OD  — CO  m 


CO  _ 00 


/OO  y*CO 

j ||y||  fY(y)  dy  = MRE(y)  . 


- 00  _ 


Finally,  the  CEP(x)  is  defined  by  the  equation 


letting  y = Px  gives 


0.5  = 


IS 


P-1y 


//  . 


||x|<;  CEP(x) 


X(x)  dx  = 0.  5 ; 


fx(p-ly)dy  = 


SI 


fy(y)  dy  * 


£ CEP(x) 


y * cep(x) 


which  is  the  defining  equation  for  CEP(y).  Hence,  CEP(x)  = CEP(y), 

COMPARISON  OF  STATISTICS 


The  interesting  property  enjoyed  by  each  of  these  statistics  is  that  the 
ratio  of  the  statistic  to  cri  depends  solely  on  the  ratios  02/01  and  03/(71, 
and  not  on  the  absolute  values  of  the  04  . It  is  therefore  convenient  to  display 
results  in  terms  of  these  ratios. 
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Figures  1 through  5 give  the  statistics  divided  by  q,  as  a function  of 
o2/ CTj,  for  CTg/aj  = 0,  0.25,  0.5,  0.75,  and  1.0,  respectively.  In  all 

cases  considered 

U MSE  2 MRE  2 SEP  s GME  . 

It  is  also  evident  from  these  curves  that  the  RMSE,  MRE,  and  SEP  all  have  the 
same  qualitative  behavior. 

The  RMSE,  MRE,  and  SEP  are  increasing  functions  of  ffo/a,  and 
, as  one  would  expect.  This  also  appears  to  be  the  case  for  the  GME , 
except  for  the  case  when  one  of  the  sigmas  equals  zero,  as  shown  in  figure  6. 
This  anomaly  results  because  different  definitions  for  the  GME  are  required 
for  the  cases  n - 2 and  n = 3.  The  definition  for  n = 3 would  result  in 
GME  = 0 whenever  one  of  the  sigmas  equals  zero,  because  the  50-percent 
ellipsoid  v'ould  reduce  to  an  ellipse,  having  area  but  no  volume.  Also,  the 
GME  will  approach  zero  as  one  of  the  sigmas  approaches  zero. 

The  ether  three  statistics,  therefore,  have  a continuity- type  property 
not  held  by  the  GME;  namely,  as  one  of  the  sigmas  approaches  zero,  the  three- 
dimensional  statistic  approaches  that  for  the  two-dimensional  case. 

At  first,  one  might  conclude  that  the  GME  is  not  a good  representative 
error  statistic,  since  an  error  vector  could  have  two  large  components  and 
one  small  one,  with  a small  resulting  GME.  This  argument  is  not  necessarily 
valid,  however,  since  one  might  be  satisfied  with  an  error  vector  if  at  least 
one  component  is  small.  In  such  cases,  the  GME  would  be  a more  suitable 
criterion  than  the  other  three  statistics,  all  of  which  tend  to  be  large  if  at 
least  one  component  is  large.  These  latter  statistics  appear  more  suitable  for 
the  most  common  case,  where  the  system  error  is  defined  (for  n = 3)  as 

E=(  yl+4+4)1/2  ■ 

where  y.  is  the  error  in  the  ith  coordinate.  In  this  context,  the  names 
given  to  the  statistics  RMSE,  MRE,  and  SEP  are  quite  natural. 


STATISTIC/O'  i 


STATISTIC/CTi 
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SUMMARY 


Explicit  expressions  have  been  given  for  four  error  statistics  frequently 
used  as  performance  criteria  for  systems  with  random  inputs.  Some  of  the 
expressions  are  new.  The  comparative  results  enable  relative  statements  to 
be  made  concerning  system  performance  when  measured  by  various  statistics. 
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